Text Coherence and Judgments of Essay Quality: Models of Quality and Coherence
نویسندگان
چکیده
This study investigates the importance of human evaluations of coherence in predicting human judgments of holistic essay quality. Of secondary interest is the potential for computational indices of cohesion and coherence to model human judgments of coherence. The results indicate that human judgments of coherence are the most predictive features of holistic essay scores and that computational indices related to text structure, semantic coherence, lexical sophistication, and grammatical complexity best explain human judgments of text coherence. These findings have important implications for understanding the role of coherence in writing quality.
منابع مشابه
An Optimal Approach to Local and Global Text Coherence Evaluation Combining Entity-based, Graph-based and Entropy-based Approaches
Text coherence evaluation becomes a vital and lovely task in Natural Language Processing subfields, such as text summarization, question answering, text generation and machine translation. Existing methods like entity-based and graph-based models are engaging with nouns and noun phrases change role in sequential sentences within short part of a text. They even have limitations in global coheren...
متن کاملCohesion, Coherence, and Expert Evaluations of Writing Proficiency
This study investigates the roles of cohesion and coherence in evaluations of essay quality. Cohesion generally has a facilitative effect on text comprehension and is assumed to be related to essay coherence. By contrast, recent studies of essay writing have demonstrated that computational indices of cohesion are not predictive of evaluations of writing quality. This study investigates expert r...
متن کاملThe tool for the automatic analysis of text cohesion (TAACO): Automatic assessment of local, global, and text cohesion.
This study introduces the Tool for the Automatic Analysis of Cohesion (TAACO), a freely available text analysis tool that is easy to use, works on most operating systems (Windows, Mac, and Linux), is housed on a user's hard drive (rather than having an Internet interface), allows for the batch processing of text files, and incorporates over 150 classic and recently developed indices related to ...
متن کاملHolistic Annotation of Discourse Coherence Quality in Noisy Essay Writing
In this paper, we describe a holistic annotation scheme for coherence quality that requires little expertise on the part of the human annotator; we also present computational systems for evaluating coherence quality in essays. A formidable challenge to reliability when annotating discourse coherence comes from differences among annotators in the inferences that they draw when reading an essay. ...
متن کامل. The Effectiveness of Metacognitive Training on Sense of Coherence and Quality of Life in Spouses of Addicted Men
Abstract Objective: The purpose of this study was to determine the effectiveness of metacognitive training on sense of coherence and quality of life in spouses of addicted men. Method: The research method was quasi-experimental with pretest- posttest design with control group and 3-months follow-up. The statistical population of this study consisted of the wives of addicted men who referred to...
متن کامل